Papers with text generation task
Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactions (2026.tacl-1)
Copied to clipboard
| Challenge: | Slot Schema Induction (SSI) is a task-oriented dialogue (TOD) system that allows for automatic identification of information slots from unlabeled data. |
| Approach: | They propose a language model that incrementally constructs and refines a slot schema over a stream of dialogue data and then automatically creates high-quality state labels. |
| Outcome: | The proposed method creates high-quality state labels for novel task domains and improves evaluation metrics. |
DP-NMT: Scalable Differentially Private Machine Translation (2024.eacl-demo)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a popular text generation task, yet there is nagging data privacy concerns. |
| Approach: | They propose an open-source framework for a privacy-preserving NMT with DP-SGD. |
| Outcome: | The proposed framework is open-source and open to the public . it combines models, datasets, and evaluation metrics to demonstrate its effectiveness. |
ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text generation use auto-regressive (AR) methods, but inefficient inference is a problem. |
| Approach: | They propose an efficient and effective PLM to explicitly model the token dependency during NAR text generation. |
| Outcome: | The proposed model outperforms existing models on three text generation tasks while achieving 10 times faster inference speedup. |
How to Avoid Sentences Spelling Boring? Towards a Neural Approach to Unsupervised Metaphor Generation (N19-1)
Copied to clipboard
| Challenge: | Existing approaches to generate metaphors rely on template-based or rule-based knowledge, which constrains the diversity of generated metaphors. |
| Approach: | They propose a neural approach to metaphor generation that uses wiki corpus to extract metaphorically used verbs and train a language model. |
| Outcome: | The proposed approach generates metaphors with good readability and creativity using wiki corpus and automatic metrics and human evaluations. |
Advancing Precise Outline-Conditioned Text Generation with Task Duality and Explicit Outline Control (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing studies on outline-conditioned text generation focus on generating text using provided outlines as rough sketches, but lack of clarity and rationality of the rough outlines hampers quality of the generated text. |
| Approach: | They propose a novel task that requires generating stories based on specific, sentence-level outlines. |
| Outcome: | The proposed framework improves the quality of precise outline-conditioned text generation. |
A Neural Approach to Pun Generation (P18-1)
Copied to clipboard
| Challenge: | generating puns with artificial intelligence techniques requires manual training and templates. |
| Approach: | They propose neural network models for homographic pun generation that can generate puns without requiring any pun data for training. |
| Outcome: | The proposed models generate homographic puns of good readability and quality without training. |
Ask to Learn: A Study on Curiosity-driven Question Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on Question Generation focuses on generating relevant questions given text with an answer . human ability to ask questions goes beyond evaluation of reading comprehension . |
| Approach: | They propose a novel text generation task based on a conversational question-asking dataset . they investigate automated metrics to measure different properties of Curious Questions . |
| Outcome: | The proposed task is based on a conversational Question Answering dataset . the results show that humans tend to ask questions with the goal of obtaining new information . |
Generating Question-Answer Hierarchies (P19-1)
Copied to clipboard
| Challenge: | a novel text generation task uses reading comprehension datasets to generate a hierarchy of question-answer pairs . users can click on high-level questions to reveal related but more specific questions . |
| Approach: | They propose a text-generating task which converts a document into a hierarchy of question-answer pairs . users can click on high-level questions to reveal related but more specific questions . they then use the specificity-labeled reading comprehension dataset to generate the hierarchy . |
| Outcome: | The proposed system can be used to generate a hierarchy of question-answer pairs based on reading comprehension datasets. |
ReTAG: Reasoning Aware Table to Analytic Text Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Table to text models generate descriptive summaries that repeat information contained within a table in sentences. |
| Approach: | They propose a table-aware table-to-text model that uses vector-quantization to infuse different types of analytical reasoning into the output. |
| Outcome: | The proposed model achieves 2.2%, 2.9% improvement on PARENT metric over state-of-the-art models. |
Cross-lingual Evaluation of Multilingual Text Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for multilingual text generation are limited by language and data leakage. |
| Approach: | They propose an annotation-free cross-lingual evaluation protocol for multilingual text generation . they first generate English references from the translated non-English inputs into English . |
| Outcome: | The proposed protocol shows a high correlation to the reference-based ROUGE metric in four languages on news text summarization. |
Unlocking Memorization in Large Language Models with Dynamic Soft Prompting (2024.emnlp-main)
Copied to clipboard
Zhepeng Wang, Runxue Bao, Yawen Wu, Jackson Taylor, Cao Xiao, Feng Zheng, Weiwen Jiang, Shangqian Gao, Yanfu Zhang
| Challenge: | Pretrained large language models excel in a variety of natural language processing tasks . however, they pose significant security risks due to their tendency to memorize training data . |
| Approach: | They propose a method to estimate LLM memorization using dynamic, prefix-dependent soft prompts. |
| Outcome: | The proposed method can achieve maximum relative improvement of 135.3% and 39.8% over baseline compared to state-of-the-art methods. |
CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to control attributes of Language Models (LMs) for text generation are not safe, as toxicity and bias goals are opposed to each other. |
| Approach: | They propose a method to control the attributes of Language Models (LMs) for the text generation task using Causal Average Treatment Effect (ATE) scores and counterfactual augmentation. |
| Outcome: | The proposed architecture achieves state of the art performance for toxic degeneration, which are computed using Real Toxicity Prompts. |
Multi-Task Learning of Query Generation and Classification for Generative Conversational Question Rewriting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to identifying ambiguous questions as part of a conversation have not addressed this challenge. |
| Approach: | They propose a multi-task learning approach that uses a text generation model for question rewriting and classification. |
| Outcome: | The proposed approach outperforms single-task learning baselines on three LIF test sets. |
See Detail Say Clear: Towards Brain CT Report Generation via Pathological Clue-driven Representation Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Brain CT report generation is important to aid physicians in diagnosing cranial diseases. |
| Approach: | They propose a Pathological Clue-driven Representation Learning model to build cross-modal representations based on pathological clues and adapt them for text generation. |
| Outcome: | The proposed method outperforms previous methods and achieves SoTA performance. |
MathAgent: Adversarial Evolution of Constraint Graphs for Mathematical Reasoning Data Synthesis (2026.findings-acl)
Copied to clipboard
| Challenge: | Current approaches to synthesising high-quality mathematical reasoning data without human priors suffer from mode collapse and limited logical complexity. |
| Approach: | They propose a hierarchical synthesis framework that formulates data synthesis as an unsupervised optimization problem over a constraint graph followed by semantic instantiation rather than a direct text generation task. |
| Outcome: | The proposed framework outperforms widely-used datasets on eight mathematical benchmarks. |